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Abstract — In this paper we analyze the performance of several 
bit-interleaving strategies applied to Non-Binary Low-Density 
Parity-Check (LDPC) codes over the Rayleigh fading channel. 
The technique of bit-interleaving used over fading channel 
introduces diversity which could provide important gains in terms 
of frame error probability and detection. 

This paper demonstrates the importance of the way of im- 
plementing the bit-interleaving, and proposes a design of an 
optimized bit-interleaver inspired from the Progressive Edge 
Growth algorithm. This optimization algorithm depends on the 
topological structure of a given LDPC code and can also be 
applied to any degree distribution and code realization. 

In particular, we focus on non-binary LDPC codes based on 
graph with constant symbol-node connection d v — 2. These 
regular (2, dc)-NB-LDPC codes demonstrate best performance, 
thanks to their large girths and improved decoding thresholds 
growing with the order of Finite Field. Simulations show excellent 
results of the proposed interleaving technique compared to the 
random interleaver as well as to the system without interleaver. 

Index Terms — Non-binary LDPC codes, bit-interleaver, 
Rayleigh fading channel, Tanner Graph. 

I. Introduction 

Since their rediscovery by MacKay fTJ in 1996, Low- 
Density Parity-Check codes have attracted a lot of attention 
because they exhibit rates close to the Shannon capacity ||2) 
for many transmission channels, despite their low decoding 
complexity. With the evolution of the technology, new families 
of LDPC codes defined on non-binary alphabets have been 
proposed and studied. They demonstrate better performance 
with respect to the binary case, especially for moderate code 
lengths [3 1 but at the expense of more complex decoding 
architectures. 

Non-binary LDPC codes can be defined by considering a 
non-binary alphabet A, which for practical reasons is often 
considered to be endowed with a vector-space structure over 
the binary field F2 = {0,1}, and a semigroup Q acting on A. 
A non-binary code of length N is hence defined as the set of 
solutions s G A of a linear system Hs T = 0, where H is a 
matrix with coefficients in Q, referred to as the parity-check 
matrix of the code. 

LDPC codes are decoded using the belief propagation (BP) 
algorithm based on an iterative exchange of messages between 
nodes H, 0. 

The case of codes for which the underlying bipartite graph 
is ultra-sparse, in the sense that each symbol-node is connected 
to exactly d v — 2 linear constraint-nodes, is of particular 
interest. First, very large girths can be obtained for Tanner 



graphs with d v = 2, as demonstrated in J6], Q. It has also 
been pointed out (8), |f3] that when the size of the non- 
binary alphabet grows, best decoding thresholds are obtained 
for average density of edges closer and closer to d v = 2. 
Practically, for NB-LDPC codes defined over Galois fields ¥ q 
with q > 64, best codes, both asymptotically and at finite 
lengths, are ultra-sparse codes. Despite those advantages, 
the ultra-sparse LDPC codes in ¥ q suffer from a serious 
drawback, as their minimum distance is limited and grows at 
best as 0(log(N)) 0. This limitation is however not critical 
when the desired error rate is above 10~ 5 , which is the case 
of the wireless transmissions that we target in this paper. 

Radio channels in multipath environments, such as mobile 
or indoor contexts, can be modeled by a Rayleigh distributed 
fading iflOll . A classical way to fight against the fading effects 
of Rayleigh model is to introduce binary diversity by the mean 
of a bit-interleaver at the transmitter side. Such interleaver that 
operates between the encoder and the symbol mapper (see 
Fig. [TJ drastically improves error rates in most of situations 
involving a fading channel. 

In this paper, we demonstrate that in the case we make 
use of NB-LDPC codes for the forward error correction, the 
bit-interleaver is still of great importance to reach good perfor- 
mance, and moreover, we show that the performance are even 
better when the bit-interleaver is well fitted to the NB-LDPC 
code structure. The proposed optimized interleaving algorithm 
is inspired from the Progressive Edge Growth algorithm, and 
associates the consecutive channel bits to the most separated 
symbol-nodes. 

The rest of the paper is organized as follows. A brief 
introduction of the NB-LDPC codes and the channel model 
are discussed in Section |II] In Section [III] the interleaving 
algorithm is presented. Performance analysis are shown in 
Section [TV] Finally, Section [VI concludes the paper. 

II. Background and Notation 

A. NB-LDPC codes over ¥ q 

We consider a non-binary alphabet ¥ q with q = 2 P elements. 
We fix once for all the isomorphism: 



¥,, 



¥1 



Elements of ¥ q are called symbols, and their images under the 
above isomorphism are called binary images. A non-binary 
LDPC code over F g is defined as the kernel of a sparse matrix 
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Fig. 1. Transmission Chain 



H G MMxAr(Fq). Thus, each codeword s composed of TV 
symbols, represents the solution of the linear system Hs T = 0. 

Associated with the matrix H is the Tanner Graph ifTTl . 
which is constituted by N symbol-nodes on the top, represent- 
ing the coded symbols, and M constraint-nodes on the bottom, 
representing, with the labeled edges, the linear constraints 
between these symbols (see Fig. |2). Each incident edge from 
symbol-node Si to constraint-node Cj corresponds to a non- 
zero entry hjj G H. 

We define node degree as the number of incident edges 
into such a node. In particular, d v indicates the variable node 
degree, whereas d c indicates the constraint-node degree. In 
Fig. |2] a Tanner graph for a (2,4)-regular code is represented 
in which all the symbol-nodes are of degree d v = 2 and all 
the constraint-nodes are of degree d c = 4. 

B. Modulation and Channel Model 

In this paper, we assume a Rayleigh channel model, typical 
of a mobile/multipath environment. Therefore, the envelope of 
the channel response follows this distribution: 

pin) — — ^ exp 57? 
and the received symbol pf. is: 

Pk = h k x k + z k 

where x k stands for the fcth transmitted modulated symbol 
scaled by i.i.d. Rayleigh factors h k , and z k is the Additive 
White Gaussian Noise with variance a 2 . 

The symbols x k are modulated by a .M-QAM constellation 
in which each mapped symbol is associated to m = log 2 M. 
bits; we denote by N m the number of modulated symbols. 

C. Belief Propagation Decoding 

The Belief Propagation (BP) decoder |T2) is based on an 
iterative message-passing algorithm. For non-binary LDPC 
codes, the extrinsic messages that circulate on the graph are 
multidimensional messages {i.e. vectors). 

The initialization messages are Likelihood probability 
weights, dependent on the channel statistics. For NB-LDPC 
codes, the decoder input consists of N Likelihood vectors 
(P(si = os)) o6 ^> where Sj denotes the ith transmitted symbol, 
i = {l,...,N}. 

In the case the order of the constellation and the order of 
the coded symbols match, the Likelihood vectors are directly 
derived from the demapped symbols. On the contrary, when 
a de-interleaver is placed before the decoder, the demapper 
performs a marginalization to transform the symbol likelihoods 
into bit-wise likelihoods, inducing a performance loss due to 
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Fig. 2. Non-Binary LDPC codes - Tanner Graph 

the marginalization. Nevertheless, the loss of information due 
to marginalization is counterbalanced by the gain that the bit- 
interleaver brings in the case of fading channels. We show in 
the result section that the diversity gain surpasses greatly the 
loss due to marginalization both in the waterfall and in the 
error floor regions. 

Now let us present in short the non-binary decoder equa- 
tions. Let P(v — a) denotes the probability that a random 
variable v G ¥ q takes on value a. A message exchanged 
between a symbol-node and a check-node is a probability 
vector of size q: 

P(») = [P(v = 0),...,P(v = q-l)] 

of a random variable v G ¥ q . 

Let a(i — > j) be the message from symbol-node S, to an 
adjacent check-node Cj and /3(j — > i) be the message from 
a check-node cj to an adjacent symbol-node Sj. With ji we 
indicate the channel likelihood for the symbol-node S£. 

Consider s G C a transmitted codeword of an LDPC code C. 
The decoder aims to detect a codeword s = s. The decoding 
process is generally composed by two half-iterations: i) update 
of symbol-node messages a(i — > j), taking into account 
the check-node messages /3(i — > j')y^j and the channel 
realizations ji, ii) update of check-node messages /3{j — > i) 
taking into account the symbol-node messages a(i' — > 
At the end of each iteration, the decoder computes the symbol 
probabilities relative to each symbol-node in order to make a 
decision about s. 

Usually, one makes the decoder stop in two situations: i) a 
maximum number of iterations is reached, then s is computed 
from the messages at the last iteration, or ii) the syndrome is 
verified Hs T = 0, and a codeword s is identified. 

A detected error happens if s does not belong to the 
codeword set. If s belongs to the codeword set but it is not the 
transmitted codeword, the decoder makes an undetected error. 
Undetected errors are due to codewords with a low Hamming 
weight, which is one the weaknesses of the considered (2, d c )- 
NB-LDPC codes. We will make in section [TV] a detailed study 
of the percentages of detected and un-detected errors in each 
interleaving situation. 

Finally, we discuss the computation of the input Likelihood 
messages in each of the considered cases. Let 3 be the vector 
of received symbols and T be the Likelihood messages at the 



inputs of symbol-nodes. In the case of N m = N and no bit- 
interleaver, there exists a one-to-one correspondence between 
the modulated and coded symbols: 
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The other case corresponds to the use of a bit-interleaver, or 
when the size of the constellation does not match the size of 
the coded symbols (N m ^ N). In such a case, an intermediate 
operation is used to transform the Likelihoods between the bits 
of the mapped symbols and the bits of the coded symbols: 

1=1 [ Pxi 1 ■ ■ ■ PxN m ] 

"bin — [(Aei.i j • • • Pxx,m) ■ • ' \PxN m ,l > • • • PxN m m )] 

r = [ 7«i » • ■ • is N } 

where H^n contains the n m received bits. These bits are 
grouped in vectors of p bits in order to obtain the messages 
which compose V. In the rest of the paper, we consider only 
the case where m = p, so that the latter marginalization 
transformation is used only when a bit-interleaver is employed. 

III. Interleaving algorithm 

The effect of a bit-interleaver is to spread the coded bits in 
different modulation symbols, such that these bits composing 
a single coded symbol are affected by different fading factors. 
The advantage of using an interleaver is that the deep fading 
effects on the received bits are mitigated by the fact that 
those bits are distributed among the codewords after the de- 
interleaver. 

The bit-interleaver can be seen as the construction of a 
superimposed regular (m,p)-bipartite graph (from now on 
called simply interleaving graph) on the Tanner Graph. It 
connects the modulation-nodes Xk to the symbol-nodes s, 
of a pre-designed Tanner Graph. The modulation-nodes are 
another type of nodes representing the modulated symbols in 
the interleaving graph. 

In the interleaving graph, edges connect N m modulation 
symbol-nodes xu to N coded symbol-nodes Sj (see Fig. |3). 
In this part of the graph, dk denotes the modulation symbol 
degree, while di denotes the coded symbol degree. To simplify 
the study, we can assume that each modulation symbol has 
constant modulation-node degree dk — m and that each coded 
symbol has constant interleaving symbol-node degree di = p. 

Of course, since the number of coded bits n can be 
computed either as the number of bits within the N coded- 
symbols or as the number of bits within the N m modulated- 
symbols Xk, we have that n = Np = N m m. 

Fig. [3] shows an example of a superimposed interleaving 
graph on the Tanner graph of Fig. [2] The interleaver is 
represented as a block denoted as II, with m = 4 edges 
for each modulation-node and p = 3 edges for each coded 
symbol-node. 




Fig. 3. Global graph 



Therefore, the aim of the a bit-interleaving design is to 
look for an interleaving pattern that contains the scrambled 
bit positions in the interleaving graph (upper part of the graph 
in the Fig. EJ. 

Though random interleaving shows already good perfor- 
mance as demonstrated in the section [IV] we have devised 
an algorithm to optimize the interleaver design, which even 
more improves the performance, especially in the error-floor 
region. The bit-interleaver optimization algorithm is presented 
in the next section. 

A. PEG Optimization Interleaving 

Our bit-interleaver design is inspired from the Progressive 
Edge-Growth (PEG) method [6| used for constructing Tanner 
graphs with large girths that progressively connects symbols 
and constraint-nodes. For this reason, from now on, our 
optimization algorithm will be identified as PEG interleaving 
algorithm. 

The PEG interleaving algorithm is efficient for creating 
good connections between the modulation and the symbol- 
nodes in a best effort way. Good connections are meant to 
give the largest possible girth to both the LDPC Tanner graph 
and the interleaving graph. Starting with the knowledge of 
m, p and the LDPC Tanner graph topology, the algorithm 
connects each modulation-node to m symbol-nodes. The 
rationale behind the optimization algorithm is to find, for each 
modulation-node, the m most distant coded symbol-nodes 
(from a topological distance point of view), and therefore to 
build connections in the interleaving graph which results in 
the best girth. It should also be noted that the bit-interleaver 
design is code-dependent. As a matter of fact, the girth 
computation during the interleaver design takes into account 
the topology of the already designed NB-LDPC code C. It 
results in particular that the bit-interleaver built with our 
algorithm is actually matched to a particular NB-LDPC code, 
which explains the further performance gains that we observe. 

We now explain the principles of the PEG interleaving 
algorithm. Recall that d, denotes the coded symbol-node 
degree and dk denotes the modulation-node degree. Before 
the algorithm starts, all the degrees are set to 0. During the 
algorithm execution, the current node degrees represent the 




number of established connections for the nodes. Thus, for a 
coded symbol-node Si, i G {1, . . . ,N}, the degree range is 
< di < p; for a modulation-node Xk, fee {1, . . . , N m }, the 
degree range is < dk < m. 

Let Xk be a modulation-node to be connected. The PEG 
interleaving algorithm chooses the first connection between 
Xk and s w . s w is a randomly chosen symbol-node among the 
available ones with the lowest current degree. Then, we expand 
both the Tanner and the interleaving graphs through the three 
types of nodes taking into account the new connection. Once 
the graph expansion is complete, the bottom of this graph 
is the set of symbol-nodes {s z } that are the most distant 
symbol-nodes from s w . Hence, the algorithm can connect 
the modulation-node Xf- to one of the coded symbol-node 
s z £ {s z } with the lowest degree. A new connection is thereby 
chosen, and the algorithm goes to the next edge selection, 
by performing the same steps - graph expansion and node 
selection. The procedure is iterated until it reaches the correct 
degree dk = m. The algorithm stops when all the modulation- 
nodes are connected. 

Note that with this PEG interleaving algorithm, only the 
coded symbol index is important for the global girth of the 
graph, and not the location of the bit inside the coded symbol 
binary map. Actually, an extra local scrambler could be added 
— at the coded symbol level — without impacting the girth 
of the global graph. In our simulations, however, this extra 
local scrambler did not impact significantly on the error rate 
performance. 

Although the above described construction could be adapted 
to any NB-LDPC code, including codes with irregular node 
distributions, we restricted our study to regular (2,<i c )-LDPC 
codes. For these codes, the error rate simulation results and 
the study of detected vs. undetected errors are conducted in 
the next section. 



IV. Simulation Results 

In this section, we present the simulation results for the bit- 
interleaved and not bit-interleaved NB-LDPC codes. Motivated 
by the good asymptotical thresholds that grows with the order 
field, we have focused on LDPC code alphabets Fg4 and 
F256- It has been shown that, for those high orders, the ultra- 
sparse NB-LDPC codes with node degree d v — 2 is the best 
choice. We have therefore simulated LDPC codes for those two 
different alphabets and two different coding rates: i) (2,6)-NB- 
LDPC codes corresponding to a rate R = 2/3 and ii) (2,12)- 
NB-LDPC codes corresponding to a rate R = 5/6. These 
NB-LDPC code Tanner graphs are designed with PEG method 
(6) (minimum girth g = 6) and decoded by using a Belief- 
propagation decoder [5 |. As said in the previous section, the 
size of the alphabet is the same of the size of modulation 
constellation: codes defined over F64 are transmitted using 
the 64-QAM modulation, whereas codes defined over F256 
are transmitted using the 256-QAM modulation. 

Each LDPC code is simulated on the Rayleigh fading 
channel with three possible transmission systems: first, a non- 
interleaved system with direct mapping from the modulation 
to the coded symbols, then with a random bit-interleaver and 
finally with our PEG-optimized interleaver. 

The curves in Fig. |4]represent the Frame Error Rates (FER) 
of the considered (2,d c )-LDPC codes defined over F64 for 
small codewords (n = 612 bits, N = 102 coded symbols) 
modulated with a 64-QAM. A significant performance gain 
can be observed both in the waterfall and in the error floor 
regions in the presence of a bit-interleaver. This shows that the 
diversity gain brought by the bit-interleaving surpasses greatly 
the information loss due to symbol-to-bit marginalization. 

As expected, the PEG interleaved system (represented by 
□) achieves roughly the same gain as random interleaving 
(represented by *) in the waterfall region, but shows also 
an improved error-floor. This was our goal of building bit- 
interleavers that optimize the girth of the global graph. 
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Fig. 6. Percentage of detected frame errors for a (2,6)-regular NB- 
LDPC code, n = 612, F 64 , 64-QAM 

In Fig. [5] we show the performance of the codes defined 
over F256 with codelength n = 816 (N — 102 coded symbols) 
and modulated with a 256-QAM. As can be seen, when the 
size of alphabet grows, bit-interleavers still gain in the error 
floor region, but the gap between the two kinds of interleavers 
vanishes. Now, let us discuss the effect of bit-interleaving and 
our optimized construction for the detection of frame errors. 
We have drawn in Fig. [6] and [7] the percentage of detected 
frame errors with respect to the FER, for the (2,6)-LDPC codes 
defined respectively in ¥$4 and in F256- 

Although it was expected, this study confirms that the better 
performance in the error floor region results from a better 
detection of frame errors. More precisely, bit-interleaving on 
a Rayleigh channel helps the decoder to avoid convergence 
to low-weight codewords, therefore improving at the same 
time the performance and the probability of error detection. 
This last feature is very interesting since in most wireless 
mobile transmissions, a link adaptation strategy implementing 
retransmission of detected wrong frames is generally used 
(ARQ or Hybrid-ARQ). 

Note that even in the case of codes in F256, our bit- 
interleaving optimization shows an interesting gain in detected 
frame errors (100% for all FER simulated) compared to the 
random-interleavers, although the error rates were the same 
(see Fig. 0. 

V. Conclusions 

In this paper we investigate the non-binary LDPC codes 
transmitted over a Rayleigh fading channel. Since modulated 
symbols can be affected by different fading factors, deep fad- 
ing could make some codeword symbols totally unrecoverable 
in case of one-to-one correspondence between modulated and 
coded symbols, leading to a poor system performance. 

In order to avoid this phenomenon, binary diversity can be 
exploited by using a bit-interleaver module placed between the 
encoder and the modulator. A random interleaver and an opti- 
mized interleaver have been analyzed by running simulations 
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Fig. 7. Percentage of detected error frames for a (2,6)-regular NB- 
LDPC code, n = 612, F 25 6, 256-QAM 



over short size regular (2, <i c )-LDPC codes. 

The optimized interleaving algorithm is inspired from the 
Progressive Edge Growth (PEG) method and it ensures max- 
imum girth of the global graph. Although the bit demapping 
needed in the interleaved leads to information loss, it has been 
demonstrated that the use of the interleaves ensures improved 
frame-error probabilities compared to a system without it. 
Additionally, in all considered cases, the optimized interleaver 
showed an even better gain with respect to the random 
interleaver, as far as performance and error detection rate s are 
concerned. 
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